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DETAILED ACTION 

Information Disclosure Statement 

The information disclosure statement (IDS) submitted on 08 September 2004. 
Examiner apologizes for not seeing the European Search Report listed. The 
information disclosure statement is being considered by the examiner. 

Response to Amendment 

The amendment filed on 19 September 2005, has been entered and made of record. 
The amended specification overcomes the drawing objection made in the Non-Final 
office action filed 17 May 2005. Claim 6 has been cancelled. Claims 1-5, and 7-23 are 
pending. 

Response to Arguments 

Applicant's arguments filed 19 September 2005 have been fully considered but 
they are not persuasive. Applicant argues the prior art (US Patent No. 6,507,358 to Mori 
et al.) does not teach or suggest the three-dimensional and two-dimensional shrunken 
images displayed on the same screen as amended in independent claims 1,10, and 11. 
However, Applicant's remarks fail to point out where in the Applicant's disclosure this 
"same screen" limitation is supported. Furthermore, Applicant's specification discloses 
the use a display that employs a liquid crystal device for a slit, as shown in Japanese 
Patent Laying-Open No. 5-122733. As disclosed starting on line 26, page 6 of 
Applicant's disclosure: 



Application/Control Number: 10/663,742 Page 3 

Art Unit: 2672 

"Display portion 10 switches between a 2D mode where the slit liquid crystal 
device is turned off for 2D image display and a 3D mode where the slit liquid crystal 
device is turned on for 3D image display. This mode switching is performed through an 
operation of mode button 19." 

Therefore, if this display is employed within Applicant's system, it would be 
difficult for both the 2D and 3D shrunken images to be displayed on the same screen 
considering mode switching is needed in order to display either 3D or 2D images. 

Claim Rejections - 35 USC § 112 

The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

Claims 1-5, and 7-23 are rejected under 35 U.S.C. 112, first paragraph, as failing 
to comply with the enablement requirement. The claim(s) contains subject matter that 
was not described in the specification in such a way as to enable one skilled in the art to 
which it pertains, or with which it is most nearly connected, to make and/or use the 
invention. 

Referring to claims 1,10, and 11, "same screen" is not supported in the 
specification. As stated in "Response to Arguments" section above, Applicant's 
specification discloses the use a display that employs a liquid crystal device for a slit, as 
shown in Japanese Patent Laying-Open No. 5-122733. As disclosed starting on line 26, 
page 6 of Applicant's disclosure: 
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"Display portion 10 switches between a 2D mode where the slit liquid crystal 
device is turned off for 2D image display and a 3D mode where the slit liquid crystal 
device is turned on for 3D image display. This mode switching is performed through an 
operation of mode button 19." 

Therefore, if this display is employed within Applicant's system, it would be 
difficult for both the 2D and 3D shrunken images to be displayed on the same screen 
considering mode switching is needed in order to display either 3D or 2D images. 

The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

Claims 1-5, and 7-23 are rejected under 35 U.S.C. 1 12, second paragraph, as 
being indefinite for failing to particularly point out and distinctly claim the subject matter 
which applicant regards as the invention. 

Claims 1, 10, and 11 recites the limitation "same screen". It is unclear how the 
2D and 3D shrunken image is to be displayed on the same screen when Applicant's 
specification discloses the use a display that employs a liquid crystal device for a slit, as 
shown in Japanese Patent Laying-Open No. 5-122733, where, "Display portion 10 
switches between a 2D mode where the slit liquid crystal device is turned off for 2D 
image display and a 3D mode where the slit liquid crystal device is turned on for 3D 
image display. This mode switching is performed through an operation of mode button 
19." [Disclosure, pp. 6, lines 26-34] There is insufficient antecedent basis for this 
limitation in the claim. 
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Claim 23 recites the limitation "information processing equipment" in line 1. It is 
unclear what this type of equipment is. There is insufficient antecedent basis for this 
limitation in the claim. 

Claim Objections 

Claim 9 is objected to because of the following informalities: Claim 9 is said to 
be dependent on cancelled claim 6. It is assumed Applicant meant for claim 9 to be 
dependent to claim 1 and is considered as such. Appropriate correction is required. 

Claims 22 and 23 are objected to because of the following informalities: It is 
unclear if both claims 22 and 23 are dependent on claim 1 1 or if they are independent 
claims that further limit the same image display device as claimed in claim 1 1 to a 
mobile phone (claim 22) or an information processing equipment (claim 23). If the 
claims are to be dependent on claim 11, it is advised the claims be written such as: "The 
image display device according to claim 1 1 wherein the image display device is a ... ". 
Appropriate correction is required. 

Claim Rejections - 35 USC § 102 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the.United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

1. Claims 1, 2, 5, 7-11, 19-21, 23 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Mori et al. (US Patent No. US 6,507,358 B1). 
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Mori et al. discloses a multi-lens pickup apparatus provided with plural image 
pickup systems an image display capable of displaying either stereoscopic or 
panoramic images. Thumbnails may be displayed corresponding to the stereoscopic or 
panoramic image [col. 3, line 63 - col. 4, line 5]. 

In regards to claim 1, 10 - 

Referring to Fig. 5, the left and right image pickup systems (52), (53) are arranged 
in converting or parallel manner, in order to pick up images that can be observed 
stereoscopically, and the liquid crystal display (LCD) (54) is capable of stereoscopic 
display, so that the observer can observe, by the LCD (54), a stereoscopic image at a 
rate same as the image pickup rate [col. 7, lines 18-24]. It would have been known in 
the art at the time the invention was made that stereoscopic images are three- 
dimensional. Figs. 8A-C illustrate a stereoscopic image generated by the process 
circuit (66) shown in Fig. 6, wherein shown is a stereoscopic image (81) in the VRAM, a 
left image (82), and a right image (83) (claims 1 , 10). In order to display the 
stereoscopic image on the LCD (54), an interlaced image (81) has to be synthesized 
from the left and right images (82), (83) [col. 8, lines 3-9]. JPEG compression is 
employed where the compressed data is stored in the work memory (632) of Fig. 15 
where the left and right compressed images are paired for file management [col. 14, 
lines 30-34]. Identification information for identifying the paired images is 
simultaneously recorded in the file management area. Also, there is recorded a 
thumbnail image together with the main image. The thumbnail image means a reduced 
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image, for example of a size of 80x60 pixels, in comparison with the main image (claims 
1,10) [col. 14, lines 35-39]. 

In regards to claim 2 - 

It is possible to switch the system from the stereoscopic image pickup to the 
panoramic image pickup by changing the direction of the left and right image pickup 
images (52), (53) of Fig. 5 from the converging or parallel arrangement to the diverging 
arrangement [col. 8, lines 55-58]. The liquid crystal display (54) may be used for 
observing both the stereoscopic image and the panoramic image [col. 8, lines 63-64]. It 
would have been known in the art at the time the invention was made that a panoramic 
image is two-dimensional. 

In regards to claim 5 - 

As the thumbnail images stored in the work memory (632) (claim 5) of Fig. 15 are 
JPEG compressed, thumbnail images are selected and transmitted to the signal 
processing circuit (527), and displayed on the liquid crystal display (504) [col. 15, lines 
12-15]. Within the thumbnail images prepared as a pair, either one is used for display. 
Fig. 17 shows the display state of thumbnail images (700) (claim 5) [col. 15, lines 19- 
21]. 
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In regards to claim 7 - 

Referring to Fig. 5, the left and right image pickup systems (52), (53) are arranged 
in converting or parallel manner, in order to pick up images that can be observed 
stereoscopically (claim 7), and the liquid crystal display (LCD) (54) is capable of 
stereoscopic display, so that the observer can observe, by the LCD (54), a stereoscopic 
image at a rate same as the image pickup rate [col. 7, lines 18-24]. It would have been 
known in the art at the time the invention was made that stereoscopic images are three- 
dimensional comprising of two, two-dimensional images, one being the left and the 
other being the right. Figs. 8A-C illustrate a stereoscopic image generated by the 
process circuit (66) shown in Fig. 6, wherein shown is a stereoscopic image (81) in the 
VRAM, a left image (82), and a right image (83) (claim 7). In order to display the 
stereoscopic image on the LCD (54), an interlaced image (81) has to be synthesized 
from the left and right images (82), (83) [col. 8, lines 3-9]. 

In regards to claim 8 - 

As the thumbnail images stored in the work memory (632) of Fig. 1 5 are JPEG 
compressed, thumbnail images are selected and transmitted to the signal processing 
circuit (527), and displayed on the liquid crystal display (504) [col. 15, lines 12-15]. The 
liquid crystal display (504) is in a two-dimensional display mode, and flag information 
indicating the stereoscopic image is displayed together with the thumbnail image (claim 
8) [col. 17, lines 15-18]. Within the thumbnail images prepared as a pair, either one is 
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used for display. Fig. 17 shows the display state of thumbnail images (700) [col. 15, 
lines 19-21]. 

In regards to claim 9 - 

Referring to Fig. 5, the left and right image pickup systems (52), (53) (claim 9) are 
arranged in converting or parallel manner, in order to pick up images that can be 
observed stereoscopically, and the liquid crystal display (LCD) (54) is capable of 
stereoscopic display, so that the observer can observe, by the LCD (54), a stereoscopic 
image at a rate same as the image pickup rate (claim 9) [col. 7, lines 18-24]. It would 
have been known in the art at the time the invention was made that stereoscopic 
images are three-dimensional comprising of two, two-dimensional images, one being 
the left and the other being the right. Figs. 8A-C illustrate a stereoscopic image 
generated by the process circuit (66) shown in Fig. 6, wherein shown is a stereoscopic 
image (81) in the VRAM, a left image (82), and a right image (83) (claim 9) [col. 8, lines 
3-9]. 

In regards to claim 11 - 

Referring to Fig. 1, the multi-lens image pickup apparatus of Mori et al. that 
comprises a left (12) and right (13) image pickup system, a liquid crystal display (14), 
and a panoramic image (15) displayed on the LCD (claim 11: camera for capturing 2D 
images) [col. 5, lines 6-1 1]. Additionally, as shown in Fig. 5, the left and right image 
pickup systems (52), (53) are arranged in converting or parallel manner, in order to pick 
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up images that can be observed stereoscopically, and the liquid crystal display (LCD) 
(54) is capable of stereoscopic display, so that the observer can observe, by the LCD 
(54), a stereoscopic image at a rate same as the image pickup rate [col. 7, lines 18-24]. 
It would have been known in the art at the time the invention was made that 
stereoscopic images are three-dimensional. It is also possible to switch the system to 
the panoramic image pickup by changing the direction of the left and right image pickup 
images (52, 53) from the converging or parallel arrangement to the diverging 
arrangement. The LCD may be used for observing both the stereoscopic image and the 
panoramic image (claim 11: display 2D or 3D mode) [col. 8, lines 55-64]. Figs. 8A-C 
illustrate a stereoscopic image generated by the process circuit (66) shown in Fig. 6, 
wherein shown is a stereoscopic image (81) in the VRAM, a left image (82), and a right 
image (83) (claims 1, 10). In order to display the stereoscopic image on the LCD (54), 
an interlaced image (81) has to be synthesized from the left and right images (82), (83) 
[col. 8, lines 3-9]. JPEG compression is employed where the compressed data is stored 
in the work memory (632) of Fig. 15 where the left and right compressed images are 
paired for file management [col. 14, lines 30-34]. Identification information for 
identifying the paired images is simultaneously recorded in the file management area. 
Also, there is recorded a thumbnail image together with the main image. The thumbnail 
image means a reduced image, for example of a size of 80x60 pixels, in comparison 
with the main image (claim 11: thumbnail) [col. 14, lines 35-39]. 
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In regards to claim 14- 

The thumbnails are accompanied by either flag S indicating the stereoscopic image 
[col. 15, lines 22-25], or flag P, indicated the panoramic image [col. 16, lines 58-60]. 

In regards to claim 15 - 

The image pickup system of Mori et al. comprises VRAM which stores both the 
panoramic and stereographic images. Additionally identification information for 
identifying the paired images is simultaneously recorded in the file management area. 
Also, there is recorded a thumbnail image together with the main image. The thumbnail 
image means a reduced image, for example of a size of 80x60 pixels, in comparison 
with the main image (claim 11: thumbnail) [col. 14, lines 35-39]. The thumbnails are 
accompanied by either flag S indicating the stereoscopic image [col. 15, lines 22-25], or 
flag P, indicated the panoramic image [col. 16, lines 58-60]. 

In regards to claim 19 - 

In Fig. 17, there are thumbnails shown (700). Based on the displayed thumbnail 
images, the operator selects an image file to be reproduced and enters an instruction 
into the camera control unit (634) [col. 15, lines 22-27]. 

In regards to claim 20 - 

At the recording of the panoramic image, a thumbnail is prepared and recorded 
[col. 16, lines 32 - 34]. Fig. 19 shows the display state of the thumbnail images of the 
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panoramic images, illustrating thumbnail images (800). The thumbnail image of the 
panoramic image is synthesized by calculating the overlapping area size for the 
thumbnail image, based on the overlapping area size of the main images [col. 16, lines 
37-42]. 

In regards to claim 21 - 

It is possible to switch the system from the stereoscopic image pickup to the panoramic 
image pickup by changing the direction of the left and right image pickup images (52), 
(53) of Fig. 5 from the converging or parallel arrangement to the diverging arrangement 
(claim 6) [col. 8, lines 55 - 58]. The liquid crystal display (54) may be used for 
observing both the stereoscopic image and the panoramic image [col. 8, lines 63 - 64]. 
It would have been known in the art at the time the invention was made that a 
panoramic image is two-dimensional. 

In regards to claim 23 - 

Referring to Fig. 5, the left and right image pickup systems (52), (53) are 
arranged in converting or parallel manner, in order to pick up images that can be 
observed stereoscopically, and the liquid crystal display (LCD) (54) is capable of 
stereoscopic display, so that the observer can observe, by the LCD (54), a stereoscopic 
image at a rate same as the image pickup rate [col. 7, lines 18-24]. 
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Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claim 3 is rejected under 35 U.S.C. 103(a) as being unpatentable over Mori et al. 

(US Patent No. US 6,507,358 B1) in view of Takiguchi (US Patent No. US 6,868,192 

B2). 

Mori et al. discloses the claimed limitations of claim 3 with the exception of teaching 
cutting portions of data that exceeds the size of the shrunken image. However, 
Takiguchi discloses an image processing apparatus where a reduced image is 
generated by cropping a section of the target image when the target image is sufficiently 
laterally wide or vertically long. 

Mori et al. discloses a multi-lens pickup apparatus provided with plural image 
pickup systems an image display capable of displaying either stereoscopic or 
panoramic images. Thumbnails may be displayed corresponding to the stereoscopic or 
panoramic image [col. 3, line 63 - col. 4, line 5]. 

Takiguchi discloses an image processing apparatus in which is case of a laterally- 
wide or vertically-long image, the user can easily and certainly recognize it by a 
thumbnail display [col. 3, lines 1-2]. As shown in Fig. 1, a terminal apparatus (100) 
comprises a personal computer having a function such that a number of images obtains 
by external equipment such as scanner, digital camera, or the like are fetched into the 
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apparatus by activating image management list display software and displayed as a list 
(thumbnail display) [col. 3, line 68 - col. 4, iine 4]. The terminal apparatus (100) has a 
display (102) for displaying various data [col. 4, lines 5-7]. Shown in Fig. 2, the image 
management list display process unit (201) fetches a number of images obtained by the 
external equipment into the terminal apparatus (100), managing those images, and 
displaying a list of them (thumbnail display) [col. 4, lines 50-54]. The image 
management list display process unit (201) performs a reducing process to the target 
image file in the memory so that the target image file goes in the thumbnail frame of a 
predetermined size, and adds the target image file after completion of the reducing 
process as thumbnail data into the thumbnail file (302) shown in Fig. 3 [col. 6, lines 7- 
12]. The image list display process unit (201) displays a list of the thumbnail data in the 
thumbnail file (302) onto the window (902) of Fig. 1 1 in the picture plane (900) displayed 
by the display (102) of Fig. 1 through the drawing management process unit (207) and 
video l/F (213) [col. 6, lines 55-59], Referring to the flowchart in Fig. 5, the image 
management list display process unit (201) discriminates whether an aspect ratio of the 
image (601) shown in Fig. 6 is larger than a predetermined value or not [col. 7, lines 3- 
5]. If the ratio of the lateral size X and vertical size Y of the image (601 ) is larger than a 
predetermined value, the image management list display process unit (201) picks out 
the image in which the ratio of the lateral size Z and vertical size Y is equal to the 
predetermined value from the mid section of the image (601) and generates it (claim 3) 
[col. 7, lines 24-32]. If the aspect ratio of the image (601) is not larger than the 
predetermined value, the image management list display process unit (201) performs a 
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reducing process to the image (601) itself so as to go in a thumbnail frame (602) of a 
predetermined size (claim 3) [col. 7, lines 40-44]. 

Therefore, it would have been obvious at the time the invention was made to 
include the cropping feature of Takiguchi with the invention of Mori et al. so that in case 
of a laterally-wide or vertically-long image, the user can easily and certainly recognize it 
by a thumbnail image [col. 3, lines 1-2]. 

3. Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over Mori et al. 
(US Patent No. US 6,507,358 B1) in view of "The Authoritative Dictionary of IEEE 
Standards, 7 th edition". 

Mori et al. teaches the claimed limitations of claim 4 with the exception of disclosing 
the image data as bitmap data. Figs. 8A - 8C illustrate a stereoscopic image generated 
by the process circuit (66) of Fig. 5, wherein shown is a stereoscopic image (81) in the 
VRAM, a left image (82), and a right image (83). In order to display the stereoscopic 
image on the liquid crystal display (54), an interlaced image (81) has to be synthesized 
from the left and right images (82), (83) [col. 8, lines 3-7]. The system of Mori et al. 
would have been considered a digital system where the images captured by the left and 
right image pickup systems (52), (53) would be a digital image. It would have been 
known to one in the art at the time the invention was made that a digital image is made 
up of an array of pixels, where each pixel has an associated value [IEEE: pg. 306]. 
Furthermore, it would have been obvious to one in the art at the time the invention was 
made to consider the right and left image data generated by the process circuit (66) to 
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be bitmap data since a bitmap contains a block of memory that stores a raster image 
where the characteristics of each pixel are determined by a set of bits [IEEE: pg. 104]. 
The VRAM (28) would have provided a means to store the image data to be displayed 
on the LCD (54). 

4. Claims 12 and 13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Mori et al. (US Patent No. US 6,507,358 B1). 

Mori et al. teaches the limitations of claim 12 and 13 with the exception of 
explicitly teaching the thumbnails of the 3D image comprising portions of both the 
corresponding left- and right-eye images (claim 12) and arranging the left- and right-eye 
images side-by-side. 

In regards to claim 12 - 

Referring to Fig. 5, the left and right image pickup systems (52), (53) are 
arranged in converting or parallel manner, in order to pick up images that can be 
observed stereoscopically, and the liquid crystal display (LCD) (54) is capable of 
stereoscopic display, so that the observer can observe, by the LCD (54), a stereoscopic 
image at a rate same as the image pickup rate [col. 7, lines 18-24]. It would have been 
known in the art at the time the invention was made that stereoscopic images are three- 
dimensional. Figs. 8A-C illustrate a stereoscopic image generated by the process 
circuit (66) shown in Fig. 6, wherein shown is a stereoscopic image (81) in the VRAM, a 
left image (82), and a right image (83). In order to display the stereoscopic image on 
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the LCD (54), an interlaced image (81) has to be synthesized from the left and right 
images (82), (83) [col. 8, lines 3-9]. JPEG compression is employed where the 
compressed data is stored in the work memory (632) of Fig. 15 where the left and right 
compressed images are paired for file management [col. 14, lines 30-34]. Identification 
information for identifying the paired images is simultaneously recorded in the file 
management area. Also, there is recorded a thumbnail image together with the main 
image. The thumbnail image means a reduced image, for example of a size of 80x60 
pixels, in comparison with the main image (claim 11: thumbnail) [col. 14, lines 35-39]. 
Since the main image is made of both the left and right-eye images, it would have been 
obvious for the thumbnail to also be made from both the left- and right-eye images 
because the left- and right-eye image data is kept separate, such as during the JPEG 
compression. 

In regards to claim 13- 

Since the thumbnails are based on the original image data, i.e. the stereographic 
data, the thumbnails contain both the left- and right-eye images. Furthermore, it would 
have been obvious to one of ordinary skill in the art that the left- and right-eye images 
be placed next to each other in order to form the stereoscopic image. Additionally, the 
thumbnail image means a reduced image, for example of a size of 80x60 pixels, in 
comparison with the main image (claim 11: thumbnail) [col. 14, lines 35-39]. Therefore, 
the original image data is reduced to a specified size. 
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Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .1 36(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michelle K. Lay whose telephone number is (571) 272- 
7661. The examiner can normally be reached on Monday - Friday, 7:00am - 4:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi can be reached on (571) 272-7664. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

Michelle K. Lay 
Patent Examiner 
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